Refactoring #91

Nindemic · 2021-07-27T18:18:31Z

WIP

Rectifies root module placements
Version upgrades
Unnecessary comments are deleted or cleaned
Updates READ.ME with correct service stack deployment instructions

02_deployHono/main.tf

02_deployHono/ambassador_mappings.yaml

* All root modules moved to the same directory level * Root modules are numbered according to apply order * Fixes Smad service stack deployment instructions * Updates READ.ME * Upgrades provider version * Unnecessary files, variables and comments are deleted Signed-off-by: Nindemic <[email protected]>

* Divides container_deployment into separate modules * Ambassador, Mongo, Jaeger and Prometheus_stack have separate modules Signed-off-by: Nindemic <[email protected]>

* Module container_registry is moved and renamed as a root module * Documentation is updates Signed-off-by: Nindemic <[email protected]>

Signed-off-by: Nindemic <[email protected]>

*Adds mongoDB storage for telemetry data *Adds Kafka mongoDB connector Signed-off-by: Nindemic <[email protected]>

* Update documentation * Fixes READ.ME instructions for module deployment * Updates docs/ARCHITECTURE.md * Updates docs/SETUP.md Signed-off-by: Nindemic <[email protected]>

Signed-off-by: Mikael Saarinen <[email protected]>

msrn · 2021-12-29T15:56:20Z

02_deployHono/modules/hono/values.yaml

+      bootstrap.servers: kafka-0.kafka-headless.default.svc.cluster.local:9092
+      security.protocol: SASL_PLAINTEXT
+      sasl.mechanism: SCRAM-SHA-512
+      sasl.jaas.config: "org.apache.kafka.common.security.scram.ScramLoginModule required username=\"hono\" password=\"hono-secret\";"


Configure Hono to authenticate with custom kafka as common client

msrn · 2021-12-29T15:57:02Z

02_deployHono/modules/kafka/values.yaml

-  jaas:
-    clientUser: hono
-    clientPassword: hono-secret


These option were deprecated on the kafka chart

msrn · 2022-01-06T12:49:27Z

.github/workflows/terraform-plan.yml

-  terraform:
-    name: 'Terraform Validate and plan'
+  test_storagerg_module:
+    name: 'Test and deploy 01_Storage_rg module with Terraform Validate and plan'


Workflow now tests and deploys the storagerg module to Azure. Deployhono -module plan would fail because that module needs outputs of storagerg -module shares. Because of this storage_rg needs to be deployed.

msrn · 2022-01-06T12:49:49Z

.github/workflows/terraform-plan.yml

+      run: terraform apply -auto-approve
+
+  test_deployhono_module:
+    name: 'Test 02_deploy_hono module with Terraform Validate and plan'


Test deployHono module with validate and plan.

Tested this workflow here
msrn#5
You can see output of checks here
https://github.com/msrn/smad-deploy-azure/actions/runs/1663019863

msrn · 2022-01-06T12:50:12Z

.github/workflows/terraform-plan.yml

@@ -61,6 +108,40 @@ jobs:
      id: plan
      run: terraform plan
      #continue-on-error: true
+
+  destroy_storagerg_module:
+    name: 'Destroy 01_Storage_rg module from Azure subscription'


Destroy previously made storagerg

*Deployment was failing due to wrong deployment order Signed-off-by: Nindemic <[email protected]>

Signed-off-by: Mikael Saarinen <[email protected]>

Signed-off-by: Nindemic <[email protected]>

Nindemic added the question Further information is requested label Jul 27, 2021

Nindemic force-pushed the master branch from 9d64d39 to accd90d Compare August 3, 2021 12:57

Nindemic force-pushed the refactoring branch 5 times, most recently from fba2ef9 to 6109598 Compare August 16, 2021 14:03

msrn reviewed Aug 16, 2021

View reviewed changes

02_deployHono/main.tf Outdated Show resolved Hide resolved

msrn reviewed Aug 16, 2021

View reviewed changes

02_deployHono/main.tf Outdated Show resolved Hide resolved

Nindemic force-pushed the refactoring branch from 6109598 to ab79ca0 Compare September 3, 2021 16:04

msrn reviewed Sep 17, 2021

View reviewed changes

02_deployHono/ambassador_mappings.yaml Outdated Show resolved Hide resolved

msrn added this to the Hono deployment milestone Nov 6, 2021

Nindemic added 7 commits December 13, 2021 15:54

Divide container_deployment into separate modules

ed0b5af

* Divides container_deployment into separate modules * Ambassador, Mongo, Jaeger and Prometheus_stack have separate modules Signed-off-by: Nindemic <[email protected]>

Move container_registry from deployHono modules

2440d7b

* Module container_registry is moved and renamed as a root module * Documentation is updates Signed-off-by: Nindemic <[email protected]>

Persistent file storage

0a47210

Signed-off-by: Nindemic <[email protected]>

Add telemetry storage

ababecb

Signed-off-by: Nindemic <[email protected]>

Adds kafka liveness probe delay

f906ed5

Signed-off-by: Nindemic <[email protected]>

Add kafka cluster and kafka connector

731e1e6

*Adds mongoDB storage for telemetry data *Adds Kafka mongoDB connector Signed-off-by: Nindemic <[email protected]>

Nindemic force-pushed the refactoring branch 4 times, most recently from cb2182d to 53cdb65 Compare December 13, 2021 16:00

Fix READ.ME & update descriptions

eb1aebc

* Update documentation * Fixes READ.ME instructions for module deployment * Updates docs/ARCHITECTURE.md * Updates docs/SETUP.md Signed-off-by: Nindemic <[email protected]>

Nindemic force-pushed the refactoring branch from 53cdb65 to eb1aebc Compare December 13, 2021 16:05

msrn added 2 commits December 15, 2021 15:54

Fix kafka ambassador mapping. Remove kafka.jks from setup.sh

84b3b96

Signed-off-by: Mikael Saarinen <[email protected]>

Fix hono auth with custom kafka

5b1d81b

Signed-off-by: Mikael Saarinen <[email protected]>

msrn reviewed Dec 29, 2021

View reviewed changes

Modify workflow to support refactored version

3bc199d

msrn reviewed Jan 6, 2022

View reviewed changes

msrn added safe-to-test PR's that are safe to test with the pipeline and removed safe-to-test PR's that are safe to test with the pipeline labels Jan 6, 2022

Nindemic force-pushed the refactoring branch from dabed23 to a3c1996 Compare January 10, 2022 08:25

Fix Terraform dependencies

7f48a7b

*Deployment was failing due to wrong deployment order Signed-off-by: Nindemic <[email protected]>

Nindemic force-pushed the refactoring branch from a3c1996 to 7f48a7b Compare January 10, 2022 12:34

msrn added 3 commits January 11, 2022 10:38

WIP: Kafka connect

5f1ae9e

Signed-off-by: Mikael Saarinen <[email protected]>

Persistent mongo-devicereg

1966a08

Signed-off-by: Mikael Saarinen <[email protected]>

Fix cert_manager depencies

dd80317

Signed-off-by: Mikael Saarinen <[email protected]>

Nindemic force-pushed the refactoring branch from e79c015 to dd80317 Compare January 31, 2022 13:03

Nindemic added 3 commits January 31, 2022 17:50

Update providers and hono chart

3baa912

Signed-off-by: Nindemic <[email protected]>

Update kube prometheus stack

643b820

Signed-off-by: Nindemic <[email protected]>

Update kafka

62dceef

Signed-off-by: Nindemic <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Refactoring #91

Refactoring #91

Nindemic commented Jul 27, 2021 •

edited

Loading

msrn Dec 29, 2021 •

edited

Loading

msrn Dec 29, 2021

msrn Jan 6, 2022 •

edited

Loading

msrn Jan 6, 2022

msrn Jan 6, 2022

msrn Jan 6, 2022

Refactoring #91

Are you sure you want to change the base?

Refactoring #91

Conversation

Nindemic commented Jul 27, 2021 • edited Loading

msrn Dec 29, 2021 • edited Loading

Choose a reason for hiding this comment

msrn Dec 29, 2021

Choose a reason for hiding this comment

msrn Jan 6, 2022 • edited Loading

Choose a reason for hiding this comment

msrn Jan 6, 2022

Choose a reason for hiding this comment

msrn Jan 6, 2022

Choose a reason for hiding this comment

msrn Jan 6, 2022

Choose a reason for hiding this comment

Nindemic commented Jul 27, 2021 •

edited

Loading

msrn Dec 29, 2021 •

edited

Loading

msrn Jan 6, 2022 •

edited

Loading