Sdg rename notebooks (Azure#3210)

* renaming notebooks for docs

* rename notebook in NOT_TESTED_NOTEBOOKS

* add workflows

* fix names in featurestore jobs

* remove workflows

* remove from readme as well

* rename notebooks

* black

* put back automation tests

* change .ipynb to .py

* more .ipynb -> .py

* change names in setup-resources.sh

* remove test notebook 7 for now

sdk/python/README.md

@@ -78,17 +78,21 @@ Test Status is for branch - **_main_**
 |endpoints|online|[online-endpoints-triton](endpoints/online/triton/single-model/online-endpoints-triton.ipynb)|Deploy a custom container as an online endpoint. Use web servers other than the default Python Flask server used by Azure ML without losing the benefits of Azure ML's built-in monitoring, scaling, alerting, and authentication.|[![online-endpoints-triton](https://github.com/Azure/azureml-examples/actions/workflows/sdk-endpoints-online-triton-single-model-online-endpoints-triton.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-endpoints-online-triton-single-model-online-endpoints-triton.yml)|
 |featurestore_sample|automation-test|[test_featurestore_cli_samples](featurestore_sample/automation-test/test_featurestore_cli_samples.ipynb)|*no description*|[![test_featurestore_cli_samples](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-automation-test-test_featurestore_cli_samples.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-automation-test-test_featurestore_cli_samples.yml)|
 |featurestore_sample|automation-test|[test_featurestore_sdk_samples](featurestore_sample/automation-test/test_featurestore_sdk_samples.ipynb)|*no description*|[![test_featurestore_sdk_samples](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-automation-test-test_featurestore_sdk_samples.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-automation-test-test_featurestore_sdk_samples.yml)|
-|featurestore_sample|notebooks|[1. Develop a feature set and register with managed feature store](featurestore_sample/notebooks/sdk_and_cli/1. Develop a feature set and register with managed feature store.ipynb)|*no description*|[![1. Develop a feature set and register with managed feature store](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-1. Develop a feature set and register with managed feature store.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-1. Develop a feature set and register with managed feature store.yml)|
-|featurestore_sample|notebooks|[2. Experiment and train models using features](featurestore_sample/notebooks/sdk_and_cli/2. Experiment and train models using features.ipynb)|*no description*|[![2. Experiment and train models using features](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-2. Experiment and train models using features.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-2. Experiment and train models using features.yml)|
-|featurestore_sample|notebooks|[3. Enable recurrent materialization and run batch inference](featurestore_sample/notebooks/sdk_and_cli/3. Enable recurrent materialization and run batch inference.ipynb)|*no description*|[![3. Enable recurrent materialization and run batch inference](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-3. Enable recurrent materialization and run batch inference.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-3. Enable recurrent materialization and run batch inference.yml)|
-|featurestore_sample|notebooks|[Network Isolation for Feature store](featurestore_sample/notebooks/sdk_and_cli/network_isolation/Network Isolation for Feature store.ipynb)|*no description*|[![Network Isolation for Feature store](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-network_isolation-Network Isolation for Feature store.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_and_cli-network_isolation-Network Isolation for Feature store.yml)|
-|featurestore_sample|notebooks|[1. Develop a feature set and register with managed feature store](featurestore_sample/notebooks/sdk_only/1. Develop a feature set and register with managed feature store.ipynb)|*no description*|[![1. Develop a feature set and register with managed feature store](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-1. Develop a feature set and register with managed feature store.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-1. Develop a feature set and register with managed feature store.yml)|
-|featurestore_sample|notebooks|[2. Experiment and train models using features](featurestore_sample/notebooks/sdk_only/2. Experiment and train models using features.ipynb)|*no description*|[![2. Experiment and train models using features](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-2. Experiment and train models using features.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-2. Experiment and train models using features.yml)|
-|featurestore_sample|notebooks|[3. Enable recurrent materialization and run batch inference](featurestore_sample/notebooks/sdk_only/3. Enable recurrent materialization and run batch inference.ipynb)|*no description*|[![3. Enable recurrent materialization and run batch inference](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-3. Enable recurrent materialization and run batch inference.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-3. Enable recurrent materialization and run batch inference.yml)|
-|featurestore_sample|notebooks|[4. Enable online store and run online inference](featurestore_sample/notebooks/sdk_only/4. Enable online store and run online inference.ipynb)|*no description*|[![4. Enable online store and run online inference](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-4. Enable online store and run online inference.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-4. Enable online store and run online inference.yml)|
-|featurestore_sample|notebooks|[5. Develop a feature set with custom source](featurestore_sample/notebooks/sdk_only/5. Develop a feature set with custom source.ipynb)|*no description*|[![5. Develop a feature set with custom source](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-5. Develop a feature set with custom source.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-5. Develop a feature set with custom source.yml)|
-|featurestore_sample|notebooks|[ADB Example - Develop a feature set and register with managed feature store](featurestore_sample/notebooks/sdk_only/ADB Example - Develop a feature set and register with managed feature store.ipynb)|*no description*|[![ADB Example - Develop a feature set and register with managed feature store](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-ADB Example - Develop a feature set and register with managed feature store.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-notebooks-sdk_only-ADB Example - Develop a feature set and register with managed feature store.yml)|
+|featurestore_sample|automation-test|[test_featurestore_vnet_samples](featurestore_sample/automation-test/test_featurestore_vnet_samples.ipynb)|*no description*|[![test_featurestore_vnet_samples](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-automation-test-test_featurestore_vnet_samples.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-featurestore_sample-automation-test-test_featurestore_vnet_samples.yml)|
 |foundation-models|azure_openai|[openai_completions_finetune](foundation-models/azure_openai/oai-v1/openai_completions_finetune.ipynb)|*no description*|[![openai_completions_finetune](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml)|
+|foundation-models|benchmarking|[evaluating_claude_models](foundation-models/benchmarking/evaluating_claude_models.ipynb)|*no description*|[![evaluating_claude_models](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-benchmarking-evaluating_claude_models.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-benchmarking-evaluating_claude_models.yml)|
+|foundation-models|benchmarking|[evaluating_oai_models](foundation-models/benchmarking/evaluating_oai_models.ipynb)|*no description*|[![evaluating_oai_models](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-benchmarking-evaluating_oai_models.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-benchmarking-evaluating_oai_models.yml)|
+|foundation-models|cohere|[cohere-aisearch-langchain-rag](foundation-models/cohere/cohere-aisearch-langchain-rag.ipynb)|*no description*|[![cohere-aisearch-langchain-rag](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-aisearch-langchain-rag.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-aisearch-langchain-rag.yml)|
+|foundation-models|cohere|[cohere-aisearch-rag](foundation-models/cohere/cohere-aisearch-rag.ipynb)|*no description*|[![cohere-aisearch-rag](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-aisearch-rag.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-aisearch-rag.yml)|
+|foundation-models|cohere|[cohere-cmdR](foundation-models/cohere/cohere-cmdR.ipynb)|*no description*|[![cohere-cmdR](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-cmdR.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-cmdR.yml)|
+|foundation-models|cohere|[cohere-embed](foundation-models/cohere/cohere-embed.ipynb)|*no description*|[![cohere-embed](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-embed.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere-embed.yml)|
+|foundation-models|cohere|[cohere_faiss_langchain_embed](foundation-models/cohere/cohere_faiss_langchain_embed.ipynb)|*no description*|[![cohere_faiss_langchain_embed](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere_faiss_langchain_embed.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-cohere_faiss_langchain_embed.yml)|
+|foundation-models|cohere|[command_faiss_langchain](foundation-models/cohere/command_faiss_langchain.ipynb)|*no description*|[![command_faiss_langchain](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-command_faiss_langchain.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-command_faiss_langchain.yml)|
+|foundation-models|cohere|[command_tools-langchain](foundation-models/cohere/command_tools-langchain.ipynb)|*no description*|[![command_tools-langchain](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-command_tools-langchain.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-command_tools-langchain.yml)|
+|foundation-models|cohere|[langchain](foundation-models/cohere/langchain.ipynb)|*no description*|[![langchain](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-langchain.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-langchain.yml)|
+|foundation-models|cohere|[litellm](foundation-models/cohere/litellm.ipynb)|*no description*|[![litellm](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-litellm.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-litellm.yml)|
+|foundation-models|cohere|[openaisdk](foundation-models/cohere/openaisdk.ipynb)|*no description*|[![openaisdk](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-openaisdk.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-openaisdk.yml)|
+|foundation-models|cohere|[webrequests](foundation-models/cohere/webrequests.ipynb)|*no description*|[![webrequests](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-webrequests.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-cohere-webrequests.yml)|
 |foundation-models|azure_openai|[openai_chat_finetune_pipeline](foundation-models/azure_openai/oai-v2/openai_chat_finetune_pipeline.ipynb)|*no description*|[![openai_chat_finetune_pipeline](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-oai-v2-openai_chat_finetune_pipeline.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-oai-v2-openai_chat_finetune_pipeline.yml)|
 |foundation-models|huggingface|[question-answering-online-endpoint](foundation-models/huggingface/inference/question-answering/question-answering-online-endpoint.ipynb)|*no description*|[![question-answering-online-endpoint](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-huggingface-inference-question-answering-question-answering-online-endpoint.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-huggingface-inference-question-answering-question-answering-online-endpoint.yml)|
 |foundation-models|huggingface|[text-generation-streaming-online-endpoint](foundation-models/huggingface/inference/text-generation-streaming/text-generation-streaming-online-endpoint.ipynb)|*no description*|[![text-generation-streaming-online-endpoint](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-huggingface-inference-text-generation-streaming-text-generation-streaming-online-endpoint.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-huggingface-inference-text-generation-streaming-text-generation-streaming-online-endpoint.yml)|

sdk/python/featurestore_sample/automation-test/featurestore_cli_job.py

@@ -9,9 +9,7 @@
         print(os.path.join(path, name))
 
 print("=======Test CLI Notebook 1============")
-with open(
-    "notebooks/sdk_and_cli/1. Develop a feature set and register with managed feature store.py"
-) as f:
+with open("notebooks/sdk_and_cli/1.Develop-feature-set-and-register.py") as f:
     exec(f.read())
 
 # print("=======Test CLI Notebook 2============")
@@ -21,13 +19,11 @@
 #     exec(f.read())
 
 print("=======Test CLI Notebook 2============")
-with open(
-    "notebooks/sdk_and_cli/2. Experiment and train models using features.py"
-) as f:
+with open("notebooks/sdk_and_cli/2.Experiment-train-models-using-features.py") as f:
     exec(f.read())
 
 print("=======Test CLI Notebook 3============")
 with open(
-    "notebooks/sdk_and_cli/3. Enable recurrent materialization and run batch inference.py"
+    "notebooks/sdk_and_cli/3.Enable-recurrent-materialization-run-batch-inference.py"
 ) as f:
     exec(f.read())

sdk/python/featurestore_sample/automation-test/featurestore_sdk_job.py

@@ -9,27 +9,25 @@
         print(os.path.join(path, name))
 
 print("=======Test Notebook 1============")
-with open(
-    "notebooks/sdk_only/1. Develop a feature set and register with managed feature store.py"
-) as f:
+with open("notebooks/sdk_only/1.Develop-feature-set-and-register.py") as f:
     exec(f.read())
 
 print("=======Test Notebook 2============")
-with open("notebooks/sdk_only/2. Experiment and train models using features.py") as f:
+with open("notebooks/sdk_only/2.Experiment-train-models-using-features.py") as f:
     exec(f.read())
 
 print("=======Test Notebook 3============")
 with open(
-    "notebooks/sdk_only/3. Enable recurrent materialization and run batch inference.py"
+    "notebooks/sdk_only/3.Enable-recurrent-materialization-run-batch-inference.py"
 ) as f:
     exec(f.read())
 
 print("=======Test Notebook 4============")
-with open("notebooks/sdk_only/4. Enable online store and run online inference.py") as f:
+with open("notebooks/sdk_only/4.Enable-online-store-run-inference.py") as f:
     exec(f.read())
 
 print("=======Test Notebook 5============")
-with open("notebooks/sdk_only/5. Develop a feature set with custom source.py") as f:
+with open("notebooks/sdk_only/5.Develop-feature-set-custom-source.py") as f:
     exec(f.read())
 
 print("=======Clean up==========")

sdk/python/featurestore_sample/automation-test/setup-resources-cli.sh

@@ -46,9 +46,9 @@ COMPUTE_SIZE="STANDARD_F4S_V2"
 az ml compute create --name $COMPUTE_CLUSTER_NAME --type $COMPUTE_TYPE --size $COMPUTE_SIZE --idle-time-before-scale-down 360 --resource-group $RESOURCE_GROUP --workspace-name $AML_WORKSPACE_NAME
 
 # <convert_notebook_to_py>
-NOTEBOOK_1="notebooks/sdk_and_cli/1. Develop a feature set and register with managed feature store"
-NOTEBOOK_2="notebooks/sdk_and_cli/2. Experiment and train models using features"
-NOTEBOOK_3="notebooks/sdk_and_cli/3. Enable recurrent materialization and run batch inference"
+NOTEBOOK_1="notebooks/sdk_and_cli/1.Develop-feature-set-and-register"
+NOTEBOOK_2="notebooks/sdk_and_cli/2.Experiment-train-models-using-features"
+NOTEBOOK_3="notebooks/sdk_and_cli/3.Enable-recurrent-materialization-run-batch-inference"
 jupytext --to py "${NOTEBOOK_1}.ipynb"
 jupytext --to py "${NOTEBOOK_2}.ipynb"
 jupytext --to py "${NOTEBOOK_3}.ipynb"

sdk/python/featurestore_sample/automation-test/setup-resources.sh

@@ -18,11 +18,11 @@ REDIS_NAME="redis"${VERSION}
 # </create_variables>
 
 # <convert_notebook_to_py>
-NOTEBOOK_1="notebooks/sdk_only/1. Develop a feature set and register with managed feature store"
-NOTEBOOK_2="notebooks/sdk_only/2. Experiment and train models using features"
-NOTEBOOK_3="notebooks/sdk_only/3. Enable recurrent materialization and run batch inference"
-NOTEBOOK_4="notebooks/sdk_only/4. Enable online store and run online inference"
-NOTEBOOK_5="notebooks/sdk_only/5. Develop a feature set with custom source"
+NOTEBOOK_1="notebooks/sdk_only/1.Develop-feature-set-and-register"
+NOTEBOOK_2="notebooks/sdk_only/2.Experiment-train-models-using-features"
+NOTEBOOK_3="notebooks/sdk_only/3.Enable-recurrent-materialization-run-batch-inference"
+NOTEBOOK_4="notebooks/sdk_only/4.Enable-online-store-run-inference"
+NOTEBOOK_5="notebooks/sdk_only/5.Develop-feature-set-custom-source"
 jupytext --to py "${NOTEBOOK_1}.ipynb"
 jupytext --to py "${NOTEBOOK_2}.ipynb"
 jupytext --to py "${NOTEBOOK_3}.ipynb"

sdk/python/readme.py

@@ -34,7 +34,7 @@
     "xgboost_service_principal",
     "using_mlflow_rest_api",
     "yolov5/tutorial",
-    "4. Provision a feature store in various ways",
+    "4.Provision-feature-store",
 ]  # cannot automate lets exclude
 NOT_SCHEDULED_NOTEBOOKS = []  # these are too expensive, lets not run everyday
 # define branch where we need this