Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] eksctl update-aws-node updated aws-eks-nodeagent to an invalid image in AWS GovCloud #7999

Open
1riggs opened this issue Oct 15, 2024 · 5 comments
Labels

Comments

@1riggs
Copy link

1riggs commented Oct 15, 2024

What were you trying to accomplish?

As part of administering an EKS Cluster in AWS GovCloud, us-gov-west-1, I upgraded the cluster version (from v1.26 -> v1.27). As per the documentation I was updating the addons, including aws-node. To that end, I ran eksctl utils update-aws-node --cluster my-cluster.

I expected the aws-node DaemonSet to update with the appropriate container versions, as documented in the eksctl documentation.

What happened?

Updated configuration included 602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-network-policy-agent:v1.1.1. This results in errors when pulling that image for the aws-eks-nodeagent:

ImagePullBackOff (Back-off pulling image "602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-network-policy-agent:v1.1.1")

How to reproduce it?

Run the aforementioned command after a cluster version update in the AWS GovCloud region, us-gov-west-1.

Logs

N/A

Anything else we need to know?

Suspect the registry/region for the aws-eks-nodeagent is incorrect. The other apps in that DaemonSet (aws-node & aws-vpc-cni-init) use 013241004608.dkr.ecr.us-gov-west-1.amazonaws.com.

Versions

$ eksctl info
eksctl version: 0.192.0
kubectl version: v1.25.16
OS: linux
Copy link
Contributor

Hello 1riggs 👋 Thank you for opening an issue in eksctl project. The team will review the issue and aim to respond within 1-5 business days. Meanwhile, please read about the Contribution and Code of Conduct guidelines here. You can find out more information about eksctl on our website

@1riggs
Copy link
Author

1riggs commented Oct 15, 2024

Manually modifying the DeamonSet to use 013241004608.dkr.ecr.us-gov-west-1.amazonaws.com/amazon/aws-network-policy-agent:v1.1.1 does work.

Copy link
Contributor

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the stale label Nov 15, 2024
Copy link
Contributor

This issue was closed because it has been stalled for 5 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Nov 21, 2024
@TiberiuGC TiberiuGC reopened this Nov 29, 2024
@TiberiuGC TiberiuGC removed the stale label Nov 29, 2024
@rachekalmir
Copy link

I ran into this same issue running:

eksctl utils update-aws-node --cluster=${cluster_name} --approve

The image gets updated to image: 602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-network-policy-agent:v1.1.1
But the cluster is in eu-west-1 so the image pull fails until you update the daemonset manually.

λ eksctl info
eksctl version: 0.194.0
kubectl version: v1.31.2
OS: windows

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants