[E2E][L0 v2] Matrix tests time-out on CI on PVC

### Describe the bug

Example run: https://github.com/intel/llvm/actions/runs/15544819604/job/43765014831

The failure only seems to happen when test-suite is run in parallel and when copy-oflload is enabled. I wasn't able to reproduce it locally.