Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TAS: respect node taints when the lowest hierarchy level is node #3658

Closed
Tracked by #3599
mimowo opened this issue Nov 26, 2024 · 6 comments
Closed
Tracked by #3599

TAS: respect node taints when the lowest hierarchy level is node #3658

mimowo opened this issue Nov 26, 2024 · 6 comments
Assignees
Labels
kind/feature Categorizes issue or PR as related to a new feature.

Comments

@mimowo
Copy link
Contributor

mimowo commented Nov 26, 2024

What would you like to be added:

Respect node taints when scheduling by TAS when the lowest hierarchy level is kubernetes.io/hostname.

Why is this needed:

Some users may want to taint a node and exclude it from TAS. However, we still should include the tainted notes for which the workload has tolerations.

@mimowo mimowo added the kind/feature Categorizes issue or PR as related to a new feature. label Nov 26, 2024
@mimowo
Copy link
Contributor Author

mimowo commented Nov 26, 2024

cc @PBundyra @tenzen-y
/assign

@tenzen-y
Copy link
Member

I discussed this with @mimowo offline.
Technically, we can check taints at all levels.
But, in that case, we need to traverse all hierarchical taints.
So, we support only the lowest hierarchy-level taints.

@mimowo
Copy link
Contributor Author

mimowo commented Nov 28, 2024

A relatively simple approach for supporting taints for any Topology levels, I discussed with @PBundyra yesterday, is to introduce a "virtual" level for nodes, even if not specified directly by the user in the Topology object. Still, it adds a bit of complexity, so I want to deliver this in two parts:

  1. respect taints if the lowest level is kubernetes.io/hostname
  2. respect taints for any topology by introducing the "virtual" level corresponding to kubernetes.io/hostname

The priority of (2.) is lower, but it should be simple so I will try to fit both into 0.10

@mimowo
Copy link
Contributor Author

mimowo commented Nov 28, 2024

After consulting this with @mwielgus we decided to defer this decision / support for later. I open KEP update to capture the need to handle topologies without hostname better: #3681

@mimowo
Copy link
Contributor Author

mimowo commented Nov 28, 2024

/close
The main issue is addressed, we will re-consider the options when there is no kubernetes.io/hostname the last level post 0.10, proposed KEP update: #3681

@k8s-ci-robot
Copy link
Contributor

@mimowo: Closing this issue.

In response to this:

/close
The main issue is addressed, we will re-consider the options when there is no kubernetes.io/hostname the last level post 0.10, proposed KEP update: #3681

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Categorizes issue or PR as related to a new feature.
Projects
None yet
Development

No branches or pull requests

3 participants