I suggest you ...

Mark data-driven tests run with "Run Functional Tests" task failed if one iteration fails

Not sure if this might even be a bug:

When using the vNext build task "Run Functional Tests" to run data-driven tests (test cases on TFS with multiple test parameters), only one successful iteration currently will mark the whole test as passed successfully.

If one or more iterations failed while other iterations went successful, there is no hint at all in the task result summary or test result. Only if you open the attached TRX file from the test result, in Visual Studio you will see test failures.

This makes the whole test result reporting useless.

A data-driven test should be marked as failed if one or more iterations have failed.

16 votes
Vote
Sign in
(thinking…)
Sign in with: facebook google
Signed in as (Sign out)
You have left! (?) (thinking…)
dbtfsbre shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

1 comment

Sign in
(thinking…)
Sign in with: facebook google
Signed in as (Sign out)
Submitting...

Feedback and Knowledge Base