Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate bug bash tests involving dominant speakers, pinning, and spotlight #5173

Merged
merged 29 commits into from
Dec 3, 2024

Conversation

mgamis-msft
Copy link
Contributor

@mgamis-msft mgamis-msft commented Sep 12, 2024

What

Add playwright tests to replace bug bash tests we do for releases

CallWithChat bug bash tests

Group call

  • Become the dominant speaker in a call with video on
  • Become the dominant speaker in a call with only audio on
  • Pin the participant from participant list, video tile should be pinned for the participant
  • Pin the participant from participant list, participant item should be pinned
  • Pin 4 participants from participant limit, try pinning 5th participant, pinning should be disabled
  • Pin the participant from video tile, participant item should be pinned for the participant
  • Unpin participant from video tile, participant item should be unpinned for the participant
  • Unpin participant from participant item, video tile should be unpinned for the participant

Calling bug bash tests

Group call

  • Pin the participant from participant list, video tile should be pinned for the participant
  • Pin the participant from participant list, participant item should be pinned
  • Pin 4 participants from participant limit, try pinning 5th participant, pinning should be disabled
  • Pin the participant from video tile, participant item should be pinned for the participant
  • Unpin participant from video tile, participant item should be unpinned for the participant
  • Unpin participant from participant item, video tile should be unpinned for the participant

Interop call

  • Pin the participant from participant list, video tile should be pinned for the participant
  • Pin the participant from participant list, participant item should be pinned
  • Pin 4 participants from participant limit, try pinning 5th participant, pinning should be disabled
  • Pin the participant from video tile, participant item should be pinned for the participant
  • Unpin participant from video tile, participant item should be unpinned for the participant
  • Unpin participant from participant item, video tile should be unpinned for the participant

Why

We can focus more on doing tests that are harder to automate during bug bashes

How Tested

Verified added playwright tests passed

Process & policy checklist

  • I have updated the project documentation to reflect my changes if necessary.
  • I have read the CONTRIBUTING documentation.

Is this a breaking change?

  • This change causes current functionality to break.

Copy link
Contributor

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

1 similar comment
Copy link
Contributor

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

Copy link
Contributor

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

1 similar comment
Copy link
Contributor

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

github-actions bot commented Dec 3, 2024

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

1 similar comment
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

github-actions bot commented Dec 3, 2024

@mgamis-msft mgamis-msft force-pushed the mgamis/automate-bug-bash-tests-phase-1 branch from 9cfbb24 to 7c71720 Compare December 3, 2024 07:12
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

github-actions bot commented Dec 3, 2024

@mgamis-msft mgamis-msft force-pushed the mgamis/automate-bug-bash-tests-phase-1 branch from 7c71720 to a2eb561 Compare December 3, 2024 07:24
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

github-actions bot commented Dec 3, 2024

@mgamis-msft mgamis-msft force-pushed the mgamis/automate-bug-bash-tests-phase-1 branch from a2eb561 to c2a3c94 Compare December 3, 2024 07:35
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

github-actions bot commented Dec 3, 2024

@mgamis-msft mgamis-msft added the update_snapshots Set this label to request automated update of UI snapshots label Dec 3, 2024
@github-actions github-actions bot removed the update_snapshots Set this label to request automated update of UI snapshots label Dec 3, 2024
@mgamis-msft mgamis-msft enabled auto-merge (squash) December 3, 2024 07:52
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Failed to pass the UI Test. If this PR is for UI change and the error is snapshot mismatch, please add "update_snapshots" label to the PR for updating the snapshot.

Copy link
Contributor

github-actions bot commented Dec 3, 2024

@mgamis-msft mgamis-msft added the update_snapshots Set this label to request automated update of UI snapshots label Dec 3, 2024
@github-actions github-actions bot removed the update_snapshots Set this label to request automated update of UI snapshots label Dec 3, 2024
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Chat bundle size is decreased✅.

  • Current size: 1762267
  • Base size: 1762268
  • Diff size: -1

Copy link
Contributor

github-actions bot commented Dec 3, 2024

CallWithChat bundle size is not changed.

  • Current size: 11767078
  • Base size: 11767078
  • Diff size: 0

Copy link
Contributor

github-actions bot commented Dec 3, 2024

Calling bundle size is not changed.

  • Current size: 11767065
  • Base size: 11767065
  • Diff size: 0

@mgamis-msft mgamis-msft merged commit a4f3225 into main Dec 3, 2024
40 of 41 checks passed
@mgamis-msft mgamis-msft deleted the mgamis/automate-bug-bash-tests-phase-1 branch December 3, 2024 20:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants