Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The report does not show the total number of tests ran #212

Open
VictorAlmeidaTR opened this issue Jun 16, 2023 · 3 comments
Open

The report does not show the total number of tests ran #212

VictorAlmeidaTR opened this issue Jun 16, 2023 · 3 comments
Labels
bug Something isn't working needs information not enough information to reproduce issue or further clarification required

Comments

@VictorAlmeidaTR
Copy link

Describe the bug
The report does not show the total number of tests ran.

For example:
In the photos I attached, I ran a total of 485 tests, but in the report it only shows 435 tests

To Reproduce
Steps to reproduce the behavior:

  1. Run all tests and compare number ran tests with report

Expected behavior
To show all tests in Report, in Version 2.35.2 works.
in version 2.40.0 not works

Environment (please complete the following information):

  • Cypress version: 12.14.0
  • OS: Linux

** Developer Tools Console Output **

Additional context
Add any other context about the problem here.

@VictorAlmeidaTR VictorAlmeidaTR added the bug Something isn't working label Jun 16, 2023
@Shelex Shelex added the needs information not enough information to reproduce issue or further clarification required label Jun 16, 2023
@VictorAlmeidaTR
Copy link
Author

checking the git actions log, I found this error, I don't know if it was related

This only happens in this version, several tests simply do not appear in the report, even if they have been executed.

In the git actions repository a value appears and in the report another appears

LOG:

2023-06-15T22:41:21.2543217Z [30148:0615/224121.252897:ERROR:ssl_client_socket_impl.cc(983)] handshake failed; returned -1, SSL error code 1, net_error -101
2023-06-15T22:41:44.1801091Z �[32m ✓�[0m�[90m MUNICIPAL --> BAURU --> OBRIGACOES - Meio Magnetico - VALIDADOR ISS.WEB (cypress/e2e/municipal/bauru/obrigacoes/obrigacoes.spec.ts)�[0m�[31m (183123ms)�[0m
2023-06-15T22:41:46.2571403Z

@PalmeiraGuilhermeTR
Copy link

I have the same problem, several tests are not appearing in the report. I've run them multiple times, and the result keeps changing. With each execution, different tests are not being reported.
My solution was to roll back the dependency to 2.35.2.
I'm analyzing the log more thoroughly, but I can't find a pattern among the failures. Even in debug mode, the log doesn't give me a more specific exception.
The only thing I've noticed is that it takes more than 450 executed tests for the problem to occur

@PolianaRufatto
Copy link

PolianaRufatto commented Aug 3, 2023

I have encountered the same issue, but seems to be related with @cypress/grep. My project comprises multiple sites, and I rely on tags to execute tests for each specific site. Typically, I use two tags for each site, namely "[all]" and "[theSiteName]".
However, the problem I'm facing is that the test report is displaying only the tests with the "[theSiteName]" tag, completely omitting the ones with the site-specific tag "[all]".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs information not enough information to reproduce issue or further clarification required
Projects
None yet
Development

No branches or pull requests

4 participants