scheduler: verify quota according to resource dimensions required by pod

[qinfustu]

Ⅰ. Describe what this PR does

fix the resources required by the pod in the quota are sufficient but the pod cannot be scheduled.

Ⅱ. Does this pull request fix one issue?

The resources required by the pod in the quota are sufficient but the pod cannot be scheduled.
e.q.
quota info

apiVersion: scheduling.sigs.k8s.io/v1alpha1
kind: ElasticQuota
metadata:
  name: quota-sub
  namespace: default
  annotations:
    quota.scheduling.koordinator.sh/runtime: '{"cpu":"40","memory":"40Gi", "nvidia.com/gpu": "6"}'
  labels:
    quota.scheduling.koordinator.sh/parent: "quota-parent"
    quota.scheduling.koordinator.sh/is-parent: "false"
spec:
  max:
    cpu: 40
    memory: 40Gi
    nvidia.com/gpu: 8
  min:
    cpu: 40
    memory: 40Gi
    nvidia.com/gpu: 8
status:
  used:
    cpu: 10
    memory: 20Gi
    nvidia.com/gpu: 8

pod info

apiVersion: v1
kind: Pod
metadata:
  name: pod-example
  namespace: default
  labels:
    quota.scheduling.koordinator.sh/name: "quota-sub"
spec:
  schedulerName: koord-scheduler
  containers:
  - command:
    - sleep
    - 365d
    image: busybox
    imagePullPolicy: IfNotPresent
    name: curlimage
    resources:
      limits:
        cpu: 2
        memory: 4Gi
      requests:
        cpu: 2
        memory: 4Gi
    terminationMessagePath: /dev/termination-log
    terminationMessagePolicy: File
  restartPolicy: Always

At this time, the pod will not be scheduled due to insufficient quota resources(nvidia.com/gpu: runtime < used). In fact, the cpu and memory required by the pod are sufficient.
There are scenarios where runtime < used appears：

• Enable the borrowing / returning of resources between different quota. But disable "used > runtime revoke" logic.
• Operators adjust quota resource distribution.

App version: 1.20
Kubernetes version (use kubectl version): 1.19

Ⅲ. Describe how to verify it

Ⅳ. Special notes for reviews

V. Checklist

• I have written necessary docs and comments
• I have added necessary unit tests and integration tests
• All checks passed in make test

[codecov]

Codecov Report

Attention: 1 lines in your changes are missing coverage. Please review.

Comparison is base (3784df1) 66.11% compared to head (4fcc3a1) 66.10%.
Report is 7 commits behind head on main.

Files	Patch %	Lines
pkg/scheduler/plugins/elasticquota/preempt.go	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1753      +/-   ##
==========================================
- Coverage   66.11%   66.10%   -0.02%     
==========================================
  Files         388      388              
  Lines       42425    42475      +50     
==========================================
+ Hits        28048    28076      +28     
- Misses      12305    12324      +19     
- Partials     2072     2075       +3     

Flag	Coverage Δ
unittests	66.10% <83.33%> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[eahydra]

@qinfustu This PR has been very clear. Nice job! And it is recommended to add some specific UT cases. This scenario is indeed easily overlooked.

[qinfustu]

I am currently on paternity leave. Please help me follow up on PR merger, @eahydra. Thx~
Besides，I will commit the UT cases over the leave.

[eahydra]

/lgtm
/approve

[koordinator-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: eahydra

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• pkg/scheduler/OWNERS [eahydra]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment