How can we improve Azure DevOps?

enable changing the order of test cases on the web gui and let them be tested in this order for manual tests

With the MTM 2012, it is possible to change the order of test cases within one test suite and this order is considered when testing. This functionality is missing in the web environment. It is not possible to order test cases and then have somebody else test them in a specific order. If a test suite is run, the tests are ordered by ID only. Make this work for manual tests.

227 votes
Sign in
or sign in with
  • facebook
  • google
    Password icon
    Signed in as (Sign out)

    We’ll send you updates on this idea

    Simon Nocher shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

    We have enabled support, on Team Services, for ordering of manual tests across static, requirement-based and query-based suites, directly from the Test hub. This functionality will become available for OnPrem with TFS 2016.

    You can read more about this from here:

    Marking this item as “Completed”.

    -Ravi Shanker

    Note: If you need the ordering support for automated tests, please vote on this uservoice item:


    Sign in
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)
      • Anonymous commented  ·   ·  Flag as inappropriate

        Hi, nice post. I wanted to know if we can find a solution to run automated test cases in a particular specified order by us.
        I tried the following options but it didn't work:
        • Created a new suit and re-ordered the test IDs(by changing the order and clicking on "apply changes") and gave run.
        • Checked all the column names values(such as 'activated date','start date','automated test id'etc.) to see if there is a pattern by which MTM picks the test case that is to be run next. Found none.
        • Created another suit and added each test case one by one. Gave run and found that they also didn’t follow the order in which they were added in the suit.

        It would be great if you could help me with it. Thanks.

      • Anonymous commented  ·   ·  Flag as inappropriate

        Problem: i have added test cases in Static suite but i want to execute them in some other order , So any one can help me out that how I can re arrange them in static suite using MTM or web TFS

      • Grégory Ott commented  ·   ·  Flag as inappropriate

        Totally agree with @Shubham Srivastava. The ordering of test cases should work with Query Base Suites and Requirement Base Suites

      • Emmanuel Jouan commented  ·   ·  Flag as inappropriate

        This can be temporarily be fixed by using the "Create copy and Add to Suite" in the required order and then deleting the original test cases that were in the wrong order as the newly copied/pasted will have new incremental IDs

      • Luciana commented  ·   ·  Flag as inappropriate

        I'm with the same problem in my team since 2012. I really would like to have users testing the system with test cases using web test manager, but it´s impossible without the correct order!

      • Shubham Srivastava commented  ·   ·  Flag as inappropriate

        Also my observation is that "Order" works only for Static Test Suites and not available for Query based suites and Requirement based suites . I think Test Manager and Visual Studio Online both should have the option to do reordering for any type of suite.

      • Don commented  ·   ·  Flag as inappropriate

        I can only agree with John Public. I am curious that have the product team here ever done real automated testing before?

      • John Public commented  ·   ·  Flag as inappropriate

        This is sorely missing from web view and rather sad that after bringing this up over two years ago and receiving that many votes all we get is an 'under review'. This feature is direly needed.

        I disagree that automated tests should not have dependencies. I understand the motivation for that statement, but testing a few dozen variations of a complex report is way faster when allowing for dependencies because each test case only has to do minor tweaks to data rather than wipe everything clean and spend extensive amounts of time to enter data differently. That is a total waste of resources even when a machine executes the tests. Same with tests that hit services that charge per hit (some geolocation services do that). Preventing unnecessary service calls not only saves time, but also a lot of money!
        Besides that, ordering tests in web view or anywhere else as no impact on independent automated tests. They will run in the set order, but they can run in any order and yield the same effect. So picking just one order will be perfectly fine.
        The more I think about it the more it seems as if this is just some statement to have a bogus reason not to implement this feature. Please prove me wrong!

      • Paolo Sotgiu commented  ·   ·  Flag as inappropriate

        The ordered execution of test is a must have for us in the scope of an automated execution of the regression test. I can't really understand what is the point in supporting it for manual tests and not for automated test (talking about coded UI)...the setup for some tests in our cases will require to duplicate a lot of the logic we already have in other test methods which are normally executed during the script (test the record creation, then the edit and then the removal....)....we will triplicate the lenght of tests and they already require 2 days to complete. At least give us the option to decide to use the ordering or not, as it is available already in MTM. I really miss NUNIT right now....

      • Gerhard Matzen commented  ·   ·  Flag as inappropriate

        I do not like to use ordered tests for automated tests. This is because the ordered tests is reported as a monolithic pass / fail in MTM. I would much rather see individual test results instead of a monolithic pass / fail.

      • Sascha Kolb commented  ·   ·  Flag as inappropriate

        If you really want to do this only for the Manual Testcases, plesae split this idea and see where the votes go. Thanks

      • Sascha Kolb commented  ·   ·  Flag as inappropriate

        Hello @Ravi.
        I dislike the way this Feature is going.

        I prrincipal agree that,
        "For automated test cases, the best practice is not to have dependencies between the automated tests"

        But, there is options, where this is not feasible, or expensive havin each case Independent.
        We e.g. use Testcases also ón a System Level with a mechatronic System, where bringing it to a inital state (rebooting) is expensive, thats why our AUTOMATIC testcases are dependend. But we want quick Feedback. Thats a trade off.

        I would really see a Option to Order ALL Testcases in future also via web.

      • Sergio commented  ·   ·  Flag as inappropriate

        ahora necesito conocer cómo se llama y dónde está ese campo "order" en SQL 2008 para imprimir un reporte... alguien sabe??? gracias

      • Sergio commented  ·   ·  Flag as inappropriate

        Yes... but in spanish...
        desde el Test Plan hay que crear una Suite, entonces adentro de la Suite vinculás el Requirement... luego, copiás los Test Cases del Requirement sobre la Suite...
        Te posicionás sobre la Suite y arriba a la derecha vas a ver un botón llamado "Order". Hacés click en ese botón, y listo... configurás el orden de los casos de prueba para esa ejecución o las posteriores.

      • Dee Huskey commented  ·   ·  Flag as inappropriate

        is there any plan to add the ability to order tests on the web, and if so when? Has a release been scheduled?

      ← Previous 1

      Feedback and Knowledge Base