Operator Wishlist for OKD

[LorbusChris]

Operator Wishlist for OKD

Currently Unavailable

• Elasticsearch Operator (https://github.com/openshift/elasticsearch-operator)
• Cluster Logging Operator (https://github.com/openshift/cluster-logging-operator)
• Knative-Serverless Operator (https://github.com/openshift-knative/serverless-operator)
• Nvidia GPU Operator (https://github.com/NVIDIA/gpu-operator)
• Local Storage Operator (https://github.com/openshift/local-storage-operator)
• Descheduler Operator (https://github.com/openshift/cluster-kube-descheduler-operator)
• Nginx Operator (https://github.com/nginxinc/nginx-ingress-operator)
• Web Terminal (https://docs.okd.io/latest/web_console/odc-about-web-terminal.html)
• Cluster Resource Override (https://github.com/openshift/cluster-resource-override-admission-operator)
• Sandboxed Containers (aka Kata Containers) (https://github.com/openshift/sandboxed-containers-operator)

Available in Community Catalog

• KubeVirt Operator (https://github.com/kubevirt/hyperconverged-cluster-operator)
• Maistra-Istio Servicemesh Operator (https://github.com/maistra/istio-operator)
• Kiali Operator (https://github.com/kiali/kiali-operator)
• Jaeger Operator (https://github.com/jaegertracing/jaeger-operator)
• ArgoCD Operator (https://github.com/argoproj-labs/argocd-operator)
• Windows Machine Config Operator (https://github.com/openshift/windows-machine-config-operator)
• Eclipse Che Operator (https://github.com/eclipse/che-operator)
• Kubeflow-OpenDataHub Operator (https://github.com/opendatahub-io/opendatahub-operator)
• OADP Operator (https://github.com/konveyor/oadp-operator)
• Cert Manager Operator (https://github.com/jetstack/cert-manager-olm)
• GitLab Operator (https://gitlab.com/gitlab-org/gl-openshift/gitlab-operator)

Available in Upstream Catalog

• Tekton Operator (https://github.com/tektoncd/operator)
• Quay Operator (https://github.com/quay/quay-operator)
• Rook-Ceph Operator (https://github.com/rook/rook)
• WildFly Operator (https://github.com/wildfly/wildfly-operator)
• Service Binding Operator (https://github.com/redhat-developer/service-binding-operator)
• Metering Operator (https://github.com/kube-reporting/metering-operator)

[bdlink]

OCP 4.6 docs have a section on Metering (missing from OKD docs) that mentions the Metering Operator from OperatorHub. This sounds like a useful operator to add. There is https://operatorhub.io/operator/metering-upstream (which mentions 4.2 version) that refers to https://github.com/kube-reporting/metering-operator but this is no longer under development.
I am not clear which specific operator the OCP document is referencing.

[kanadaj]

Does the upstream rook-ceph operator work? Or does it need additional SCCs?

[bdlink]

Please add gitlab operator, see https://gitlab.com/gitlab-org/gl-openshift/gitlab-operator/ It manages the GitLab runner that allows gitlab-based pipelines on OCP (so hopefully OKD). It is not on operatorhub.io
This is used in some redhat blogs as well, see https://www.openshift.com/blog/building-openshift-pipelines-with-gitlab

[chriskuipers]

I thought it was just us not having access to these operators! But apparently we're not the only ones... I'm here for the popcorn 🍿

[ibotty]

Rook-ceph works great if deployed using the openshift-sccs from its examples. It is not using OLM though.

[OleksandrShtepa]

Please, add openshift-local-storage https://github.com/openshift/local-storage-operator

[LorbusChris]

I've updated the list with the latest suggestions

[msheldyakov]

KubeVirt Operator now available in community catalog https://github.com/operator-framework/community-operators/tree/master/community-operators/community-kubevirt-hyperconverged

Tekton-Pipelines Operator deprecated and archived. the OpenShift Pipeline Operator lives in the tektoncd/operator upstream repository. https://github.com/tektoncd/operator

[LorbusChris]

thanks @msheldyakov, I've updated the list :)

[msheldyakov]

New item for wishlist https://github.com/openshift/cluster-kube-descheduler-operator
I could not find it in the community and upstream.

[danielchristianschroeter]

https://github.com/nginxinc/nginx-ingress-operator would be great for OKD, too :)

[ibotty]

We have that great list. What can one do to help getting more operators into the OKD OperatorHub?

[vrutkovs]

This list can be split in several categories:

• OCP operators requiring a community version.
  These usually don't apply to upstream k8s, so it needs to be put in the future OKD-specific catalog.
  This would be taken care internally.
• Other operators:
  Example: nginx-ingress-operator (possibly)
  It needs to be submitted by community members to https://github.com/operator-framework/community-operators.
  If the operator doesn't need any changes (i.e handles SCCs) it can be made available in OKD by submitting to community-operators folder. Otherwise we need to work upstream to have native OKD support in the operator to achieve that.

[binnes]

New item for Wishlist - Openshift Pipelines (Tekton) - https://github.com/openshift/tektoncd-operator

[openshift-bot]

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[vrutkovs]

/lifecycle frozen

[nevidanniu]

https://docs.okd.io/latest/web_console/odc-about-web-terminal.html
looks like doc for openshift operator "web terminal" occasionally appeared in okd docs, but it would be great to add it to community operators

[ibotty]

openshift/oadp-operator#722 says that oadp is not supported.

[kaovilai]

@ibotty community support is not official support. Our community support ends at OADP 0.5.6 currently.

[dymurray]

To be extra clear, OADP is shipped as part of Red Hat official operators. When OADP became supported we stopped maintaining the community version. If someone installs the red hat operator catalog source they will be able to install the latest version of OADP.

[bdlink]

To be extra clear, OADP is shipped as part of Red Hat official operators. When OADP became supported we stopped maintaining the community version. If someone installs the red hat operator catalog source they will be able to install the latest version of OADP.

Unfortunately the Red Hat operator catalog is not accessible to OKD. Stopping supporting the community version means OKD is stuck at the 0.5.6 community version.

[darren-oxford]

Unfortunately the Red Hat operator catalog is not accessible to OKD. Stopping supporting the community version means OKD is stuck at the 0.5.6 community version.

In order to access the RedHat catalog, you need a subscription key. You have the option of applying for a free developer account that will enable you to enable the RedHat operator catalog in OKD. What is not entirely clear is what the license then permits.

I thought that the license excluded using the RedHat catalog and images in production, but it has been suggested that is not the case.

What is really needed is absolute clarity on the issue, is it the case that…

A: A developer key enables people to use the RedHat operator catalog and images in any environment including a production OKD cluster, simply without the ability to access support by raising a support ticket.

B: A developer key enables limited use of RedHat catalog in development and testing environments but for production use, the user is prohibited from using the RedHat supplied images and must therefore either build from the public source or use a community built image.

[vrutkovs]

You don't necessarily need the subscription key to use OKD and Red Hat subscription key usage is out of scope for this ticket. Please clarify with Red Hat support on the implications of using developer subscription in production

[bdlink]

It would be helpful to have a list of openshift github repos for the Red Hat OCP versions of the operators.

For example, TektonCD does allow building an openshift version of the operator (with features not in the k8s one), but for Knative, there is a separate repository for Red Hat Openshift Serverless at https://github.com/openshift-knative/serverless-operator

Note the above repository is not under github.com/openshift (but there is one for knative-eventing !). It seems the Red Hat version requires an older version than the current knative version. Installing the knative version on a test OKD has not yet been successful for me.

If we need to build the operators ourselves, it would be useful not to have to reverse engineer the (open source) Red Hat versions.

Thanks in advance.

[binnes]

Personally I would like to see an OKD catalog in OperatorHub so OKD users don't need to build their own versions of commonly used operators

We should be able to create this as a community project, ideally using Tekton pipelines to have the ability to build the catalog (and contained operators) from GitHub source on an OKD cluster.

[binnes]

Following the working group meeting 5 July 2022, we are hoping to create an OKD community created operator hub catalog. My suggested list of operators to work on first is as follows:

Operators to allow OKD to act as a build system:

• OpenShift Data Foundation (rook / ceph / noobaa) – this is required to install the Project Quay operator available in the community catalog on OKD
• Pipelines (Ideally OpenShift pipelines operator, but can use the upstream Tekton operator as it supports OpenShift)
• GitOps (Ideally the OpenShift gitops operator, this is lower priority as there is the ArgoCD operator in the community hub)

A second priority is to enable development on cluster, so the images used in pipelines can be used in OpenShift Workspaces using a devfile to facilitate development without needing to do local installs

• Web Terminal
• DevWorkspaces (needed for web terminal and che/Code Ready Workspaces renamed to OpenShift Dev Spaces)
• OpenShift Dev Spaces (this could use the community catalog che operator)

The last section is for operators that add extensions to support application development and running

• Serverless (KNative)
• Service Mesh (Istio)

[binnes]

Source for OCP and OKD Operator catalogs are here : https://github.com/orgs/redhat-openshift-ecosystem/repositories

[ibotty]

I would certainly like the local storage operator to be in the okd operators. Without this operator it's pretty hard to install rook or openshift monitoring performantly.

[OleksandrShtepa]

Cert Manager Operator is available now in OKD 4.11. I had install it successful.
GitLab Operator is available, not tried.
GitLab Runner Operator is available, but can not be installed via bug

[vrutkovs]

Thank you, updated the issue description

[imdmahajankanika]

Is it possible to add the operator for stackrox (RHACS)?

[shdwchn10]

Please add to the list ClusterResourceOverride and Sandboxed Containers operators

[kaplan-michael]

Hey, Can the ODF operator be added to the wish list? https://github.com/red-hat-storage/odf-operator
What needs to be done to support it? It seems it installs fine with OLM(latest from the repo) but fails on pulling registry.redhat.io/openshift4/ose-kube-rbac-proxy:v4.11.0. So that would have to be rebuilt somewhere without a pull secret required.

I'm happy to help get that done.

[vrutkovs]

What needs to be done to support it?

A public rebuild of all ODF components with a different names/branding (similar to CentOS/RHEL situation). For start we can start with hard fork and then work with ODF team to make sure its useful for both endusers and developers, so that devs would use it as upstream.
This applies to pretty much every operator in this list

[ibotty]

https://docs.okd.io/4.14/networking/ingress-node-firewall-operator.html#ingress-node-firewall-operator is also missing outside of RedHat subscriptions.

[kaplan-michael]

@vrutkovs

A public rebuild of all ODF components with a different names/branding (similar to CentOS/RHEL situation). For start we can start with hard fork and then work with ODF team to make sure its useful for both endusers and developers, so that devs would use it as upstream. This applies to pretty much every operator in this list

Not sure where the hard form should be done(destination) and not sure what the with a different names/branding should be? I don't have the contacts to work with the ODF team to make it a useful upstream for them. I'm happy to help with the work on public rebuilds. pinged you on kubernetes slack with more details.

[Tiriyon]

Hey, is this issue still in the works?

I am trying to install an operator that seems to be missing:

• Local Storage Operator (https://github.com/openshift/local-storage-operator)

Is this still missing? is this list still updating?

[margaretjoanmiller]

Is there a way to add CloudNativePG operator?

[stolencode]

fresh deployment of OKD 4.14, bare metal UPI x86_64. kubernetes-nmstate and metallb operators are missing.

[lfarkas]

Following the working group meeting 5 July 2022, we are hoping to create an OKD community created operator hub catalog. My suggested list of operators to work on first is as follows:

Operators to allow OKD to act as a build system:

• OpenShift Data Foundation (rook / ceph / noobaa) – this is required to install the Project Quay operator available in the community catalog on OKD • Pipelines (Ideally OpenShift pipelines operator, but can use the upstream Tekton operator as it supports OpenShift) • GitOps (Ideally the OpenShift gitops operator, this is lower priority as there is the ArgoCD operator in the community hub)

was there any progress with it? or what is the current situation about it?

[bo0ts]

The OADP Operator operator is no longer available in community (or only an outdated version). The link now redirects to openshift-adp which requires a RedHat subscription.

[0xHexE]

I found some operator sources which can be helpful.

apiVersion: operators.coreos.com/v1alpha1
kind: CatalogSource
metadata:
  name: okd-catalog
  namespace: openshift-marketplace
spec:
  displayName: OKD Catalog
  image: 'quay.io/okderators/catalog-index:odf'
  publisher: OKD Pipeline
  sourceType: grpc

Some operator works some not but good start

apiVersion: operators.coreos.com/v1alpha1
kind: CatalogSource
metadata:
  name: operatorhubio-catalog
  namespace: openshift-marketplace
spec:
  displayName: Community Operators
  image: 'quay.io/operatorhubio/catalog:latest'
  publisher: OperatorHub.io
  sourceType: grpc

[GingerGeek]

@0xHexE Would be great to understand what issues you see with the operators.

The catalog source you have listed for okderators is a testing branch (odf) - this won't continue to be updated and may have bad builds pushed to it.

The recommended installation manifest can be found here

We will likely close this issue and move discussion over to the OKDerator project

[guliaka]

cilium operator

[llomgui]

cilium operator

https://github.com/isovalent/olm-for-cilium