Add comprehensive Kubeflow integration test GitHub Actions workflow

[kunal-511]

Pull Request Template for Kubeflow Manifests

✏️ Summary of Changes

GitHub Actions workflow implements full end-to-end integration testing for Kubeflow deployment. The workflow automates testing of critical Kubeflow components, including authentication, pipelines, notebooks, and machine learning services.

🐛 Related Issues

Fix #3054

✅ Contributor Checklist

• I have tested these changes with kustomize. See Installation Prerequisites.
• All commits are signed-off to satisfy the DCO check.

---

You can join the CNCF Slack and access our meetings at the Kubeflow Community website. Our channel on the CNCF Slack is here #kubeflow-platform.

[kunal-511]

@juliusvonkohout I have drafted a PR but not sure how to test the github action file locally.

[juliusvonkohout]

Please reuse the files under /tests and do not duplicate them inline. Try to stay close to the individual test, if possible copy from the individual tests.

[juliusvonkohout]

/ok-to-test

[juliusvonkohout]

Please reference the existing scripts and files under / tests everywhere, do not just copy it over.

[juliusvonkohout]

The goal is not to copy the readme, but to reuse and recombine our existing tests. Only what is missing can come from the readme. So the readme comes last, after you have combined the workflows here https://github.com/kubeflow/manifests/tree/master/.github/workflows using the scripts and objects from here https://github.com/kubeflow/manifests/tree/master/tests

[juliusvonkohout]

/ok-to-test

this way each commit tests it.

[juliusvonkohout]

Can you use the scripts from /tests and the other workflows to replicate that ?

[juliusvonkohout]

For example https://github.com/kubeflow/manifests/blob/master/.github/workflows/pipeline_test.yaml and https://github.com/kubeflow/manifests/blob/master/.github/workflows/pipeline_run_from_notebook.yaml can be copied to cover the pipeline part.

https://github.com/kubeflow/manifests/blob/master/.github/workflows/spark_test.yaml for spark and so on.

[kunal-511]

Please do not do a merge from master. Now the commit history is damaged and the DCO check is broken. Please always rebase to master.

Ohk my bad. Should I close this PR and create a new one ?

[juliusvonkohout]

AH now it is really broken. you probably did a merge instead of a rebase and i see 45 files changed.

please revert that commit and do a proper rebase.

[juliusvonkohout]

and fixed

[juliusvonkohout]

https://github.com/kubeflow/manifests/actions/runs/14129788932/job/39587035095?pr=3070is probably failing at Run # Use the Dex login test script directly from tests directory because something is missing from https://github.com/kubeflow/manifests/blob/master/.github/workflows/dex_oauth2-proxy_test.yaml

[juliusvonkohout]

Do you have https://github.com/kubeflow/manifests#pre-commit-hooks enabled ?

[kunal-511]

Do you have https://github.com/kubeflow/manifests#pre-commit-hooks enabled ?

No i will do it

[juliusvonkohout]

We also need to make sure that the naming is consistent with all the individual Workflows.

[kunal-511]

I have fixed all the lint issues and added pre commit

[juliusvonkohout]

Sorry, but your push again destroyed the commits. Please delete your local branch and clone again.

[juliusvonkohout]

Thank you very much for the PR. To make your life easier, I will merge it now and you can start with a fresh master branch in a follow-up PR.
Congratulations

/lgtm
/approve

[google-oss-prow]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: juliusvonkohout

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [juliusvonkohout]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[kunal-511]

Thank you very much for the PR. To make your life easier, I will merge it now and you can start with a fresh master branch in a follow-up PR. Congratulations

/lgtm /approve

Can you please tell what all things are still pending ?

[juliusvonkohout]

Thank you very much for the PR. To make your life easier, I will merge it now and you can start with a fresh master branch in a follow-up PR. Congratulations
/lgtm /approve

Can you please tell what all things are still pending ?

You can start with a fresh master branch and comment back in

#  pull_request:
#    branches:
#    - master

in a PR.

https://github.com/kubeflow/manifests/actions/runs/14131804046/job/39593790222?pr=3070 shows that we already got to the Katib test.

So you just fix the remaining tests. I think the kserve and katib installation is missing. To add it you can again borrow from the individual workflows.