-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
26 changed files
with
412 additions
and
24 deletions.
There are no files selected for viewing
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -63,4 +63,4 @@ spec: | |
resources: | ||
- name: nvidia.com/gpu | ||
replicas: 7 | ||
default: "single" | ||
default: "default" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
102 changes: 102 additions & 0 deletions
102
kubernetes/arc1/apps/machine-learning/qlora/app/helmrelease.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,102 @@ | ||
--- | ||
# yaml-language-server: $schema=https://raw.githubusercontent.com/bjw-s/helm-charts/main/charts/other/app-template/schemas/helmrelease-helm-v2.schema.json | ||
# TODO: Finish this | ||
apiVersion: helm.toolkit.fluxcd.io/v2 | ||
kind: HelmRelease | ||
metadata: | ||
name: &app qlora | ||
spec: | ||
interval: 30m | ||
chart: | ||
spec: | ||
chart: app-template | ||
version: 3.5.1 | ||
sourceRef: | ||
kind: HelmRepository | ||
name: bjw-s | ||
namespace: flux-system | ||
install: | ||
remediation: | ||
retries: 3 | ||
upgrade: | ||
cleanupOnFail: true | ||
remediation: | ||
strategy: rollback | ||
retries: 3 | ||
values: | ||
controllers: | ||
qlora: | ||
type: deployment | ||
annotations: | ||
reloader.stakater.com/auto: "true" | ||
pod: | ||
runtimeClassName: nvidia | ||
terminationGracePeriodSeconds: 1 | ||
affinity: | ||
nodeAffinity: | ||
requiredDuringSchedulingIgnoredDuringExecution: | ||
nodeSelectorTerms: | ||
- matchExpressions: | ||
- key: nvidia.com/gpu.present | ||
operator: In | ||
values: | ||
- "true" | ||
containers: | ||
app: | ||
image: | ||
repository: ghcr.io/rarecompute/qlora-docker | ||
tag: main@sha256:e56350596e17af5198bfc848b0de3a5a11cb98d97e1e02dbb322467269342541 | ||
env: | ||
TZ: ${TIMEZONE} | ||
# GITHUB_REPO: https://github.com/RareCompute/example-models | ||
NVIDIA_VISIBLE_DEVICES: all | ||
NVIDIA_DRIVER_CAPABILITIES: all | ||
securityContext: | ||
capabilities.drop: ["ALL"] | ||
resources: | ||
requests: | ||
cpu: 200m | ||
memory: 8Gi | ||
limits: | ||
cpu: 16 | ||
memory: 32Gi | ||
nvidia.com/gpu: 4 | ||
# probes: | ||
# liveness: | ||
# enabled: true | ||
# readiness: | ||
# enabled: true | ||
# startup: | ||
# enabled: false | ||
# spec: | ||
# failureThreshold: 30 | ||
# periodSeconds: 5 | ||
service: | ||
app: | ||
controller: *app | ||
annotations: | ||
teleport.dev/name: *app | ||
labels: | ||
teleport: enabled | ||
ports: | ||
http: | ||
port: &port 80 | ||
persistence: | ||
app: | ||
storageClass: local-nvme | ||
accessMode: ReadWriteOnce | ||
size: 2Gi | ||
globalMounts: | ||
- path: /app | ||
workspace: | ||
storageClass: local-nvme | ||
# TODO: OpenEBS only support ReadWriteOnce | ||
accessMode: ReadWriteOnce | ||
size: 2048Gi | ||
retain: true | ||
globalMounts: | ||
- path: /workspace | ||
tmp: | ||
type: emptyDir | ||
globalMounts: | ||
- path: /tmp |
6 changes: 6 additions & 0 deletions
6
kubernetes/arc1/apps/machine-learning/qlora/app/kustomization.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
--- | ||
# yaml-language-server: $schema=https://json.schemastore.org/kustomization | ||
apiVersion: kustomize.config.k8s.io/v1beta1 | ||
kind: Kustomization | ||
resources: | ||
- ./helmrelease.yaml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
--- | ||
# yaml-language-server: $schema=https://raw.githubusercontent.com/fluxcd-community/flux2-schemas/main/kustomization-kustomize-v1.json | ||
apiVersion: kustomize.toolkit.fluxcd.io/v1 | ||
kind: Kustomization | ||
metadata: | ||
name: &app qlora | ||
namespace: flux-system | ||
spec: | ||
targetNamespace: machine-learning | ||
commonMetadata: | ||
labels: | ||
app.kubernetes.io/name: *app | ||
path: ./kubernetes/arc1/apps/machine-learning/qlora/app | ||
prune: true | ||
sourceRef: | ||
kind: GitRepository | ||
name: k8s-gitops | ||
wait: false | ||
interval: 30m | ||
retryInterval: 1m | ||
timeout: 5m | ||
postBuild: | ||
substitute: | ||
APP: *app |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
--- | ||
apiVersion: cert-manager.io/v1 | ||
kind: Certificate | ||
metadata: | ||
name: teleport-tls | ||
namespace: security | ||
spec: | ||
secretName: teleport-tls | ||
issuerRef: | ||
name: letsencrypt-production | ||
kind: ClusterIssuer | ||
dnsNames: | ||
- "teleport.${SECRET_EXTERNAL_DOMAIN}" | ||
- "*.teleport.${SECRET_EXTERNAL_DOMAIN}" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,12 @@ | ||
--- | ||
apiVersion: v1 | ||
kind: PersistentVolumeClaim | ||
metadata: | ||
name: teleport | ||
namespace: security | ||
spec: | ||
storageClassName: local-nvme | ||
accessModes: ["ReadWriteOnce"] | ||
resources: | ||
requests: | ||
storage: 8Gi |
18 changes: 18 additions & 0 deletions
18
kubernetes/arc1/apps/security/teleport/app/resources/token.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
kind: token | ||
version: v2 | ||
metadata: | ||
name: kubernetes-token | ||
# set a long expiry time, the default for tokens is only 30 minutes | ||
expires: "2050-01-01T00:00:00Z" | ||
spec: | ||
# Use the minimal set of system roles required. | ||
roles: [kube, app, discovery, node, windowsdesktop] | ||
|
||
# set the join method allowed for this token | ||
join_method: kubernetes | ||
|
||
kubernetes: | ||
type: in_cluster | ||
allow: | ||
# Service account names follow the format "namespace:serviceaccountname". | ||
- service_account: "security:teleport-kube-agent" |
Oops, something went wrong.