Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filename incorrect when tests fail as other #402

Open
ittaibaratz opened this issue Jun 27, 2024 · 0 comments
Open

Filename incorrect when tests fail as other #402

ittaibaratz opened this issue Jun 27, 2024 · 0 comments

Comments

@ittaibaratz
Copy link

Describe the bug

I am using the following report name + Cypress 9.4.1 (Yes old):

cypress/reports/mochawesome/mochawesome_[status]_[name]  

In one of my suites, one test fails. The JSON top level stats for some reason bucket it as "others". Note it did not fail in a before hook:

"stats": {
"suites": 4,
"tests": 8,
"passes": 7,
"pending": 1,
"failures": 0,
"start": "2024-06-27T16:24:44.641Z",
"end": "2024-06-27T16:26:48.837Z",
"duration": 124196,
"testsRegistered": 9,
"passPercent": 87.5,
"pendingPercent": 11.11111111111111,
"other": 1,
"hasOther": true,
"skipped": 0,
"hasSkipped": false
}

Failure:

{
"title": "amazon s3 enable saving",
"fullTitle": "Destinations Accounts w/ records amazon s3 enable saving",
"timedOut": null,
"duration": 65368,
"state": "failed",
"speed": null,
"pass": false,
"fail": true,
"pending": false,
"context": "[\n  \"/home/jenkins/workspace/form-platform-ui-client_PR-11259/cypress/screenshots/destinations/destination-accounts-spec.js/<Test name>\",\n  \"/home/jenkins/workspace/form-platform-ui-client_PR-11259/cypress/node_modules/cypress-multi-reporters\"\n]",
"code": "...",
"diff": null
},
"uuid": "00030964-c122-4062-a652-f11e59ae58b2",
"parentUUID": "0a899bf8-80c8-47f5-bf4e-6a00768c20b3",
"isHook": false,
"skipped": false

The result filename is "mochawesome_pass_destination-accounts-spec.json"

Code Reproduce
This is a private repo and the issue does not reproduce often since the test is flakey...

Expected behavior
My expectation is if other > 0, filename should be fail and not pass.

Screenshots
If applicable, add screenshots to help explain your problem.

Environment (please complete the following information):

  • Ubuntu
  • mochawesome version - 6.2.0
  • Cypress 9.4.1
  • Node 20.9.0

Additional context
Add any other context about the problem here.

I can calculate the stats from the JSON, was just hoping to rely on the filename.

@ittaibaratz ittaibaratz changed the title Filename incorrect when tests fail in hooks Filename incorrect when tests fail as other Jun 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant