Errors and warnings in test logs will be shown in the summary of the pipeline run

[tongyuze]

Hi there, I'm using Vstest@2 in our CI pipeline to run the XUnit C# tests. The problem is that we are logging some warnings and errors inside the test logs. And they will be treated as an error in the summary of the pipeline run though the tests and tasks are actually passing. My question would be how I can suppress these errors in the summary page since it will confuse the person who click inside the run.

[tongyuze]

Here is an example:

[nohwnd]

Can you please share in which version of VSTest is this happening, this was a problem in 17.11.0 and was solved in 17.11.1 #5184

[tongyuze]

Can you please share in which version of VSTest is this happening, this was a problem in 17.11.0 and was solved in 17.11.1 #5184

Hi @nohwnd, thanks for your response. It is 17.11.1:

[tongyuze]

I think there are some differences between this and the issue you shared. This issue doesn't fail the test. It is shown as passed. However, the goal I'd like to achieve is to show the logs without highlighting the warnings and errors. The warnings and errors in the test logs are expected, it will be confusing when they are shown in the run summary like this:

The top 2 are regular test failures, and then the expected warnings and errors from the test logs.

[nohwnd]

can you tell me how exactly you are logging the warnings and errors, or make a repro please? I am not sure if this is the ado agent picking this up from the message (but I doubt that), or the bug is not being fixed, or something else.

Thanks.

[tongyuze]

I'm not sure if you can access this link to take a look: https://office.visualstudio.com/OneAuth/_build/results?buildId=32294904&view=results

[tongyuze]

We have two types of logging since we have two different libraries, but errors and warnings will be treated as errors for both of them. The string format is just like the screenshot. I'm thinking somehow it (the vstest?) will try to match the string ("warning" and "error") in the lines and do some operations?

[tongyuze]

@nohwnd This issue is important to us. Please let me know if you need more information. Thanks!